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. 2-2 Client-side Initialization 



SRE 

1. SR Initialize 



Allocate 
memory 



220 



Create source & 
coder objects 221 




220A 

2. Calibrate speech & 

Calibrate Silence until 

silence is detected 

222 



Configuration file 
221 Bl 



MS Agent 220B 



1. Initialize 
COM library 
223 



4. Get 

character 

interface 



226 



2. Create 
instance of Agent 
Server 224 



5. Add commands 
to Agent character 
option 



3. Load MS Agent 



Load the character 
by specifying path 
of the character file, 
character ID, and 
request ID 225 



6. Show the 

agent character 
228 




7. AgentNotifySink to handle the events 



Create Agent 
notify sink 
object 229 



Get Agent 
property 
interface 231 



Register sink 
object 230 



Assign property 
sheet to Agent 

232 



8. Display 
Character & 
execute 
specified 
Animations 233 



I C ommunication 220 C 



1. Open Internet 
Connection 234 




2. Set callback 
status to the 
connection 235 




3. Start new HTTP 
internet session with 
the server 236 
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Speech 
rom User 



Fig. 3 

Client-side Iterative Process 



Encoded 
MFCC 



Receive User Speech (when User speaks through microphone by clicking 
on Start button) 

240 



SRE 



Communication 



1 . Prepare 
Coder 

248 



2. Start 
Source 



249 



3. Convert 
speech into 
MFCC vectors 
250 



1. Encode MFCC 
vectors to make it 
compatible to 
send at server 
using HTTP 251 



2. Send 
encoded 
data to 
server252 



3. Wait for 
response from 
server 



253 
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Receive Answer (from Server side) 
j MS AGENT 



243 



244 



1. Receive 
uncompressed 
Answer 254 



2. Articulate the 
Received Answer 
255" 



; Speak Best 
i suitable Answer 



245 



TEXT-TO-SPEECH ENGINE 



Natural 
Language Voice 
Data File 256 



Text-to-Speech 
Engine 257 



COMMUNICATION 



1 . Receive the 
"Best" Answer 
from server 
(compressed) 

258 



2. Uncompress 
the Answer 

259 



246 



3. Pass 
Answer to 
MS Agent 

260 



Best Answer from Server 



Fig. 4 

Client-side Un-lnitialization 



SRE 270 



1 . Delete Objects and 
De-allocate Memory 



a. Deallocate the 
memory 
assigned to the 
object holding 
the parameters 
for speech 273 




b. Delete all the 
objects created in 
the initialization 
process 

274 


► 



1 COMMUNICATION 2Z1 

1 . Close the Internet 2. Close the 

connection previously Internet Session 

established with created at the time 

server 275 ^ of initialization 



MS AGENT 
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1 . Release 
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Interface 
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2. Release 

Character 

Interface 
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3. Unload the 
Agent 

279 



4. Release 
sink object 



Interface. 
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5. Release 
Property Sheet 
Interface 281 



6. Un register 
Agent Notify 
sink 282 



7. Release 
Agent 

Interface 283 
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Execute the SQL 
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